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(54) Tide: FORCE FEEDBACK FOR VIRTUAL REALITY 
(57) Abstract 

A system for producing realistic tactile feedback 
forces in a tool operation simulator. Sensors (25) sense 
the location and direction of movement of a simulated 
tool (1 1) in a simulated landscape environment to produce 
electrical signals representing three-dimensional location 
and direction of movement These electrical signals are 
processed by re-programmable processors (28) to produce 
control signals (30) that are fed to pneumatic bi-directional 
piston-type actuators (14) to impart realistic forces similar 
to forces that would be encountered in corresponding real- 
life movement of the simulated tool (11). 
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rORCTT FEEDBACK FOR VTKTUXL REALITY 
This invention relates to force feedback for virtual reality 
and aore particularly to simulation employing realistic force 
5 feedback that may be used in training personnel in instrument 
manipulation and other techniques. 

BACKGROUND OF THE IKVENTTON 
Minimally invasive surgery and procedures often involve more 
precise manipulation of tools and instruments than open incision 
10 surgery since the point of manipulation (which is external) often 
is relatively remote from the tissue being examined or treated 
the latter, of course, being internal. Thus, manual feel, cause 
and effect aore not instructively intertwined, for the point at 
which manipulation of the medical instrument occurs is located a 
15 substantial distance from the point of contact or observation 
within the patient, thus imparting a level of remoteness and 
indirection which requires a particularly high level of skill by 
the medical practitioner. For these reasons, the training of 
practitioners using live human subjects is more dangerous in that 
20 errors and mistakes are much more difficult to correct or 
overcome . 

Although training on animal subjects such as pigs is 
helpful, it is of limited availability. Furthermore, practice on 
live subjects does not offer repeatable or "staged" situations 
25 for iterative practice. Accordingly, simulator systems with 
lifelike characteristics become highly desirable. 
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20 



A useful and practical simulation system for minimally 
invasive surgical techniques should: 

(1) Define an environment in which activities are to be 
simulated, the allowable limits within which changes in that 
environment are controlled, and the movement of raaneuverable 
bodies therein; 

(2) Define allowable movements of manipulated "instruments 
and provide physical constancy; 

(3) Determine the position within or relative to the 
defined environment of manipulated "instruments"; 

(4) Provide one or more sensory (tactile, aural, and 
visual) simulation stimuli to the user with any change in the 
position determined in (3) above within the confines defined by 
(1) and (2) above; and 

(5) Re-define (1) and (2) above if change limits are 
exceeded. 

In a complete system, there should first be presented to the 
user a simulation of the external appearance of the subject, 
i.e., a physical simulation of the human torso simulating as 
nearly as possible the colored skin surface texture, and the 
under skin muscle, bone and body cavity feel. Also presented 
should be simulated instrument handle portions that should be of 
the same configuration as actual instrument handles. These 
handles optionally may be equipped with appropriate 
instrumentation as necessary or desirable and may already be in 
position protruding from the simulated torso when the user is 



2 



BNSDOCID: <WO 961 8942A1 > 



WO 96/18942 



PCT/US95/16360 



familiar with the initial insertion and location techniques of 
the instruments. 

The only view and feel of the interior wording area that a 
surgeon is provided in actual surgery is through a television 
5 monitor and tactile physical feedback through the instrument 

handles he is manipulating. The interior simulations need not be 
provided by interior physical reproductions or even physical 
analogs but are adaptable to synthetic sensations electronically 
produced in response to manipulation of the simulated instrument 
10 (i*e., implement) handles. 

For tactile response simulation, defining digital data for 
one or more simulated instruments to be used including their' 
dimensions, movement limits and active functions such as grasp, 
clamp, cut and other manipulative functions may be stored in high 
15 speed accessible electronic memory. Environment-defining digital 
data for areas of use immediately surrounding the defined 
instruments such as "clear" areas, objects (organs, etc.)/ 
position, shape and texture and their give and resilience and 
movement-resistant forces and interactive connections with other 
20 objects likewise may be stored in high speed accessible 
electronic memory. 

Simulation for visual displays may comprise "multilayer" 
background "landscape" video information that may be actual 
photographic data digitized and stored in laser disc, electronic 
25 or other types of memory. The multilayer arrangement provides 

means to provide a sense of depth in the two-dimensional display 
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through relative movement and interaction with computer graphic 
anatomical objects in the layers, such as organs. 

Additional stored visual data is required to provide visual 
representation of the immediate worJc area, e.g., the internal 
5 landscape, for the surgeon, including specific organs and anatomy 
to be worked on. This data, likewise may be wholly photographic 
data or partially photographic data such as tissue textures, 
stored in digital form. 

The manipulatable visual information may be provided through 

10 a process of computer animation whereby data from "position" 
sensors and realistic defining photographic data is used to 
create and present visual and tactile representations showing the 
actions and movement of the "unseen" portions of the simulated 
instruments being manipulated by the simulator user. 

15 Additionally, computer animation may be used to create and 

present a visual representation of the "focus" organ or 
anatomical region to be manipulated and operated on by the user 
through the simulated instrument and to show the results on that 
"focus" region of the implement manipulation using data from the 

20 implement position sensors and defining data of the anatomical 
region • 

To complete the simulation, data processors may be used to 
provide interactions necessary to coordinate the tactile and 
visual feedbacks and presentations to the simulation user for the 
, 25 real time simulation of an actual surgical operation or other 

procedure tinder the control of the user. A comprehensive system 
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embodying the foregoing criteria is described in co-pending 
United States Patent Application Serial Number 08/341 . 686 filed 
November 17, 1994 » the disclosure of which is incorporated 
herein by reference. However , certain features of the tactils 
5 force feedback proposals hereof are deemed to have applicability 
in areas beyond those of surgical procedure simulation and 
diagnosis. Thus, the present invention may be directed to 
sensing, processing and providing simulations of feel for a 
variety of procedures, 

10 

3RIZF SUMMARY OF THT INVENTION 
The tactile force feedback system according to the ir.v*:-cion 
hereof provides a realistic feel to simulated procedures by 
monitoring the relative positions of relevant parts of the 

15 equipment being used, for example, the positions of simulated 
instruments relative to body organs, accessing a data bank to 
obtain indicia representing real life forces that would be 
encountered in corresponding real-life situations, and imparting 
to such simulated instruments forces that would be occasioned in 

20 real life, for example in actions such as tugging, tearing, 

cutting, clipping, stapling, pulling, pushing, grasping probing 
and maJcing contact. It also can be used with procedures such as 
turning, twisting, torquing, mounting, and the like when its 
principles are extended to mechanical applications. However, in 

25 the preferred embodiment hereof, it is directed to a simulated 
body cavity and real-time video, scopes, surgical and simulated 
therapeutic instruments (i.e., implements), foot pedals for 
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cautery and fluoroscopy and realistic torsos that house both 
sophisticated sensors Tor scopes and changeable implements, the 
tactile force feedback providing realistic feel when implements 
(i.e., simulated instruments) are manipulated and contact body 
5 parts. In so doing, it makes use of computers and sophisticated 
electronics such as field programmable gate arrays (hereinafter 
FPGA • s ) to which sensors and force controllers are connected in 
groups herein referred to as pods. 

Interconnected with the computers are high capacity memories 

10 adapted for storing a myriad of different anatomical "pavilions" 
(i.e., areas of the body that allow remote procedures). Each of 
these anatomical pavilions is likewise extendible to a number of 
minimally invasive procedures, diagnostic and therapeutic, for 
which anatomical landscapes, virtual organs and a variety of 

15 simulated instruments may be created in virtual reality. 

Although in the preferred illustrative embodiment hereof, 
the principles of the invention are utilized in providing tactile 
force and feel for medical procedures, it will be apparent that 
the aforementioned high capacity memories could readily store 

20 information on mechanical pavilions. However, returning to the 
preferred embodiment, computers and the field programmable gate 
arrays (FPGA's) provide a basic platform that can also be used 
for multimedia training in auxiliary medical areas. These 
include Endoscopic Retrograde Cholangiopancreatography (ERCP) for 

25 viewing internal bile and pancreatic ducts and Sphincterotomy for 
cutting and widening bile and pancreatic ducts for better 
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drainage or stone removal; Laparoscopic Surgical Skills and 
landscapes for the lungs, the heart, male and female reproductive 
organs, arthroscopic surgical areas such as the shoulder, eye 
surgeries, ear, nose and throat procedures and neuroscopic 
S procedures* 

The system according to the invention additionally embodies 
realistic real-time force-feel representations of organ movement 
and response to tugging, pulling, cutting and the like. 
As mentioned above, there is imparted to implement 
.0 manipulation a realistic real-life and real-time simulation of 
forces to which the simulated instrument would be subjected in 
actual manipulation and surgery. In addition to the 
aforementioned pods, there are provided a sophisticated dynamics 
model that defines the shape and other characteristics of- organs 
L5 and other relevant portions of the landscape so that forces on 
impact, collision, contact cutting and the like are faithfully 
developed and transmitted to the handles or other portions of the 
implements being manipulated by the user. 

Accordingly, the present invention provides a cost 
20 effective enhanced level of life-like virtual simulation that 
provides real time realism in patient simulation, realistic 
landscapes, and physical character including tactile force 
feedback. 
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OBJECTS AND FEATTTRES OF THE TMVENTTOM 

It is one general object of the invention to improve realism 
in simulation systems. 

It is another object of the invention to reduce costs of 
5 such systems. 

It is yet another object of the invention to increase 
versatility in such systems. 

It is yet another object of the invention to provide for 
ready extension and adaptation of such systems to a variety of 
10 procedures. 

Accordingly, in accordance with one feature of the 
invention, a plurality of off-the-shelf programmable arrays are 
employed to interact with sensors and controllers, thereby 
reducing cost and enhancing flexibility and extendibility. . 
15 In accordance with another feature of the invention, the 

aforementioned programmable arrays are interconnected with high 
capacity memories in which physical qualities of relevant parts 
of work subjects, e.g., simulated patient internal landscapes, 
are modeled and stored, thereby providing such programmable 
20 arrays with information with which to produce life-like, force- 
representing indices. 

In accordance with another feature of the invention, sensors 
and force-producing elements are connected in groups to 
individual discrete programmable arrays, thus providing sub— 
25 groups herein referred to as pods and increasing efficiency of 
the overall system. 



BNSDOCID: <WO 961 6942A1 > 



WO 96/18942 



PCT/US95/16360 



In accordance with still a further feature of the invention, 
the aforementioned force-producing elements employ compressible 
fluids in producing forces, thereby contributing to production of 
life-like feel. 

S In accordance with yet one further feature of the invention, 

a plurality of pods may be interconnected with each other and 
with a host computer through conventional small computer 
interfaces using data word packets, thus contributing to 
flexibility, utility and low cost. 

10 In accordance with still another feature of the invention, a 

variety of selectible simulated instruments may be conditioned to 
include life-like force feel in real time, thus contributing to 
faithful simulation. 

In accordance with yet one further feature of the invention, 

15 realistic tactile force feedback is provided in real time to the 
system user, thus providing a realistic feel to procedures such 
as tugging, tearing, cutting, clipping, stapling, pulling, 
pushing, grasping and probing. 

In accordance with still another feature of the invention, 

20 the ready reprogrammability of the individual discrete 

programmable arrays or similar electronics facilitates switching 
between different modes of operation such as between a diagnostic 
and therapeutic mode, thus facilitating versatility and 
extendability of operation. 

25 In accordance with yet another feature of the invention, the 

aforementioned reprogrammability facilitates complete or partial 

9 
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selective disablement: of force feedback for selected procedures, 
thus contributing to versatility. 

These and other objects and features of the invention 
will be apparent from the following description, by way of 
5 example of a preferred embodiment, with reference to the drawing. 

BRIEF DESCRIPTION OF THE DRAWING 
Figure 1 is a view schematically depicting the tactile force 
feedback system according to the invention; 

Figure 2 is a sequential flow diagram illustrating the 
10 operative steps employed by the system in operation; 

Figure 3 is a pneumatic control diagram illustrating control 
and flow of a compressible fluid to actuate force feedback 
actuators ; and 

Figure 4 is a diagram illustrating the grouping of sensors 
15 and processors into the aforementioned pods. 

DESCRIPTION OF A PREFERRED EMBODIMENT 
Now turning to the drawing, and more particularly Figure 1 
thereof, it will be seen to depict schematically a tactile force 
feedback system having a simulated instrument, i„e„, implement 11 
20 which, as described in the above-described co-pending 

application, is selectable to represent any of a plurality of 
selectable medical tools. Pivot 12 represents the swivelable 
force— imparting feature of the mounting within the trocar which 
also is described in the co-pending application. Curved handle 
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portion 13 represents the proximal end of the implement 11 and is 
provided to facilitate manual manipulation and control. 

Schematically representing the f orce-imparting coupling of 
implement 11 to pneumatic piston-type actuator 14 is a mechanical 
linkage 15 comprising extending arm 16 mounted to pinion 17 in 
cooperative engagement with rack 18 such that when a piston 
within pneumatic actuator 14 moves, a corresponding linear 
movement represented by arrow 19 is imparted to rack 18 whence it 
is communicated through pinion 17, extending arm 16 and 
swivelable force-imparting member 12 to implement 11. It should 
be noted that this representation is schematic and that a variety 
of force- imparting couplings could readily be employed. 

To provide for ready monitoring of the movement of pinion 17 
there is included a conventional electrical sensing member 20 
whose sensing relationship to pinion 17 is represented by dashed 
line 21; and connecting electrical sensing member 20 to encoder 
22 is electrical path 23. Also connected to encoder 22 via path 
24 are a plurality of additional conventional sensors 25 which 
are positioned to sense both position and movement of the distal 
part 26 of implement 11, thus providing means for continuously 
monitoring such location and movement. The preferred encoder is 
Xilinx part XC 303 0-70-PC44 . 

As will be evident to those skilled in the art, encoder 22 
encodes (preferably digitally) the sensor signals arriving 
thereat via paths 23 and 24. It then extends such encoded 
signals via path 27 to processor 28 which preferably is of the 

11 
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field programmable gate array (FPCA) type. An example of such a 
suitable array is that which is sold under the trademark "Xilinx" 
by the Xilinx Corporation and is part XC-4005-5-PG156 . 

As mentioned previously, it is one of the features of the 
5 invention hereof that system architecture provides for grouping 
of sensors and processors into what is known herein as pods. 
Such is shown in Figure 4 and described in more detail below. By 
utilizing high capacity FPGA processors, re-programmability is 
efficaciously included at a relatively low system level, thereby 

10 providing flexibility for individual re-programming to represent 
differing characteristics of differing sensors for various 
simulated instruments and tools. 

Also connected to processor 28 is high capacity memory 29 
which is in bi-directional electrical communication via channel 

15 30. In high capacity memory 29 there are stored indicia 
representing physical characteristics of the simulated 
environment in which implement 11 is employed. Thus, for example 
(and as is set forth in the aforementioned co-pending application 
to which reference is made above) , such indicia include those of 

20 internal body landscapes, geometries of organs, their locations 
within body cavities, their physical characteristics such as 
resilience, resistance to cutting, pulling, tugging and the like, 
and other indicia for providing processor information needed to 
develop signals extended via paths to electric valve control 3 3 

25 and proportional valve 34. 
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Electric valve control 33 responds to control signals 
received via path 31 by actuating air redirection valves 3 5 to 
direct air received through air pipe 36 from digital proportional 
valve 34. Thus, valves 3 5 controllably extend an internal path 
5 from air pipe 36 to either air pipe 37 or air pipe 38. When air 
is communicated via pipe 38, it results in movement of a piston 
within actuator 14 to move rack 18 outwardly, and when 
communicated via pipe 3 7 to move rack inwardly, thus controlling 
the direction of movement as represented by bi-directional arrow 

10 19. The degree of force with which such movement is produced is, 
of course, proportional to the pressure of the air communicated 
to actuator via pipes 37/3 8 which in turn is proportional to the 
air pressure within air pipe 36, the latter being controlled 
within a range of from 0 to 50 psi by digital proportional valve 

15 34. Thus, although pressure of air received via air pipe 39 from 
source 40 is essentially constant, under control of force- 
representing signals received via signal path 32, digital 
proportional valve 3 4 controllably reduces such pressure to a 
variable value preferably lying in the range of from 0 to 50 psi, 

20 at which pressure such air is communicated to air pipe 36. 

It will now be seen that both the direction of movement of 
rack 18 and the force which is imparted thereto are determined by 
electrical signals produced by processor 28 in response to 
positioning and movement of implement 11 within a simulated body 

25 landscape established by memory 29. 
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The foregoing description relates to the production of 
unidimensional realistic tactile forces simulating those that 
would be encountered when utilizing the selected instrument in a 
selected procedure. However, it will be apparent to those 
5 skilled in the art that a real procedure is geometrically three 
dimensional (i.e., partaking of x, y and z dimensions) and that 
consequently two additional configurations similar to the one of 
Figure 1 are needed to supply simulated forces in the remaining 
two dimensions. Accordingly, it should be understood that two 

10 such additional configurations are included within the scope 

hereof, the direction of application of forces to the application 
point (e.g. , location 12) of the implement being effectively at 
right angles to each other. 

It should also be understood that associated with implement 

IS 11 and force-imparting member 12 (and associated with sensors 25) 
are elements for sensing longitudinal and rotational movement of 
instrument 11 along and about its axis and for imparting thereto 
tactile feedback forces. Such are occasioned through the 
provision of longitudinal and circumf erencial peripheral bar 

20 codes which are read by the sensors to monitor such movement • 

Tactile force feedback is preferably provided thxough one or more 
spring and inflatable donut combinations (not shown) that are 
positioned surrounding implement 11. 

Reference is now -made to the diagram of Figure 2 which is a 

25 combination physical element and procedure flow diagram that may 
be helpful to a clear understanding of the invention. In the 

14 
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upper left portion of the figure there is seen a procedure 
selector represented by a bloc* 50 that includes the text 
"Selection of Simulated Procedure. n As mentioned above, features 
of the invention include the provision for optional selection 

S from multiple simulated procedures and multiple simulated 

instruments. When selection of a procedure to be simulated is 
made as by turning a )cnob or touching an inscribed surface on a 
conventional procedure monitor, sensors 51 are conditioned 
correspondingly to sense relevant parameters such as position and 

10 direction of movement of the simulated instrument within the 

simulated selected procedure. The outputs from the sensors are 
processed as described with respect to Figure 1 by encoding such 
as by encoder 52 and then at least temporarily stored in memory 
53. A path 54 is provided to connect memory 5 3 with the high 

15 capacity memory 5 5 that contains indicia representing the . 

procedure internal landscape, herein also referred to as the 
"dynamics engine" 56. As will be observed, the high capacity 
memory/ dynamics engine 55/56 (generally corresponding to high 
capacity memory 29 in Figure 1) are bi-directionally 

20 interconnected by paths 57 and 58 with pod processor 59 
(generally corresponding to processor 28 of Figure 1.) 

The upper part of the path depicted on the right-hand side 
of Figure 2 is generally similar to that just described. Thus, 
it begins with selection of the simulated type of instrument to 

25 be used with instrument selector as represented by block 60. 

When this is accomplished as, for example by turning a selector 
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switch or touching a labelled region of a monitor screen, 
implement sensors 61 are conditioned accordingly. Then when 
movement of the simulated instrument occurs, the sensors 61 
produce electrical signals that faithfully represent the position 
5 and characteristics of a real-life instrument. These electrical 
signals are encoded as by encoder 62 before being entered via 
path 6 3 into memory S3 whence they are communicated as needed by 
dynamics engine/memory 55/56 over path 54 along with the 
aforementioned signals relating to selection of the simulated 

10 procedure. 

When the system user (student) manipulates the simulated 
instrument implement as represented by rectangle 64, such 
movement is detected by sensors 6 5 which develop representative 
electrical signals that are sent to encoder 66 before being 

15 inputted to pod processor 59 where they result in production of 
the signals that control the piston type force-feel actuator 67 
corresponding to pneumatic piston type actuator 14 of Figure 1. 
This , then, produces the tactile forces that are communicated 
(e.g., mechanically coupled) to the simulated instrument 

20 implement and result in the aforementioned realistic feel 

imparted to its movement and operation as represented by coupler 
rectangle 68 . 

As mentioned above, one of the features of the invention 
lies in the seeming realism with which the user senses what 
25 appear to be real-life forces* The use of a compressible fluid, 
e.g. air, contributes importantly to such realism for it assists 

16 
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in the inclusion of a measure of -give" that facilitates 
simulation of resilience as is in the tissue of human organs. 
Moreover, air is plentiful, easy to compress and non- toxic. 

An example of a suitable air header is shown in Figure 3. 
5 There, it will be seen is a 100 psi regulated air source 70 to 
which compressed air is introduced from a conventional air 
compressor source (not shown) . The air from regulated source 70 
is conducted via conventional tubing through master shut-off 
valve 71 and thence through output 71A to regulated air header 72 
10 whence it is distributed via 4-way connector 73 and 3-way 
connectors 74a-b to header piping extensions 72a-f. 

Connected to extension 72a is a 50 psi regulator 7S, the 
output of which is connected via 3-way connector 76 to piston 
control valves represented by valve assembly 77 and valve.. 
15 assembly 78. Output 77A provides air output to urge the , above- 
mentioned piston of actuator 14 in Figure 1 toward the left, and 
output 78A provides air output to urge the above-mentioned piston 
of actuator 14 in Figure 2 toward the right. 

Now turning to Figure 4, it will be observed to depict the 
20 aforementioned plurality of pod processor/ encoder sensor 

assemblies corresponding to processor 28 and connected sensors 25 
and encoder 22 shown in Figure 1 as well as pod processor 59 
shown in Figure 2 . There, in Figure 4 are shown Pod -Processors 
1-3 identified with, reference numerals 101-103. Also shown is a 
25 dashed line rectangle which represents additional optional pods 
104 that may be included to provide other tactile forces as 
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desired* Connected to each processor 101, 102, 103 . . . are 6 
sensors 105a-f, 106a-f, I07a-f which generally correspond to 
sensors 25 in Figure l. However, it should be noted that a fewer 
number of individual sensors may be connected to the processors 
5 if sensing needs so suggest. 

Each pod processor 101, 102, 103 . . . is also connected to: 
(1) its own associated air reduction valve/electric control 
assembly 108/109, 111/112, 114/115 . . . ; (2) its own digital 
proportional valve 110, 113, 116; and via path 117 to the 

10 dynamics engine/memory as represented by rectangle 29 in Figure 1 
and elements 55/56 in Figure 2, As mentioned above, each pod 
processor preferably is a Field Programmable Gate Array such as 
that sold under the identification XC-4005-5-PG156 by the Xilinx 
Corporation. Since it is fully and readily re-programmable, pods 

15 can be easily re-programmed to be reflect different 

characteristics of simulated instruments and landscapes, thereby 
providing flexibility and extendibility to the system. 

It will now be evident that there has been described herein, 
an improved force feedback simulator that is flexible, 

20 extendible, readily re-programmable and that provides realistic 
and life-like tactile forces for simulated instruments in 
simulated procedures, thus contributing to its attractiveness and 
desirability. 

Although the invention hereof has been described by way of a 
25 preferred embodiment, it will be evident that other adaptations 
and modifications may be employed without departing from the 
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spirit and scope thareoC. For example, and as mentioned above, 
the principles hereof could readily be extended to non-medical 
areas such as flight simulators and pilot training. 

The terms and expressions employed herein have been used as 
5 terms of description and not of limitation; and thus, there is no 
intent of excluding equivalents, but on the contrary it is 
intended to cover any and all equivalents that may be employed 
without departing from the spirit and scope of the invention. 
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What is Claimed is: 

1. A system for producing realistic tactile feedback forces in 
a tool operation simulator comprising: 

(a) a selectable predetermined simulated operational 
environment defined by electrical signals; 
5 (b) a simulator implement for simulating a selected tool 

and adapted for operator manually controlled movement of said 
implement relative to said simulated operational environment; 

(c) a plurality of sensor means responsive to movements of 
said implement to produce electrical signals representative of 

10 movements of an actual tool of the type simulated in an actual 
environment of the type being simulated; and 

(d) force generation means responsive to said representative 
electrical signals and to said defining electrical signals to 
impart proportioned forces to said implement. 

2. A system for producing realistic tactile feedback forces 
according to Claim 1 further including memory means and wherein 
said defining electrical signals are stored in said memory means. 

3 • A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said defining electrical signals are 
digital. 
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4. A system for producing realistic tactile feedback forces 
according to Claim 2 wherein said defining electrical signals are 
digital. 

5. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said defining and representative 
electrical signals are digital. 

6. A system for producing realistic tactile feedback forces 
according to Claim 2 wherein said defining and representative 
electrical signals are digital. 

7. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said selected tool is selectable 
from among a plurality of different simulated tools. 

8- A system for producing realistic tactile feedback forces 
according to Claim 7 wherein said plurality of different 
simulated tools are selectable by an operator. 

9. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein identity of said selected tool is 
represented by a predetermined electrical signal. 
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10. A system for producing realistic tactile feedback forces 
according to Claim 2 wherein identity of said selected tool is 
represented by a predetermined electrical signal. 

11. A system for producing realistic tactile feedback forces 
according to Claim 10 wherein said predetermined electrical 
signal is digital and stored in said memory means . 

12. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said sensors are further responsive 
to positioning of said implement to develop position-indicating 
indicia indicative of the position of said implement within said 

5 simulated operational environment. 

13. A system for producing realistic tactile feedback forces 
according to Claim 12 wherein said position-indicating indicia 
comprise position-indicating electrical signals. 

14 . A system for producing realistic tactile feedback forces 
according to Claim 13 wherein said position- indicating electrical 
signals are encoded digitally. 

15. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said force generation means 
comprises a plurality of fluid responsive members* 
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16. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said force generation means 
comprises a plurality of compressible fluid members* 

17. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said force generation means 
comprises a plurality of compressed air responsive members, 

18. A system for producing realistic tactile feedback forces 
according to Claim 1 wherein said force generation means 
comprises a plurality of compressed air-operated piston-type 
members . 

19. A system for producing realistic tactile feedback forces 
according to Claim 18 wherein said piston-type members are bi- 
directional. 

20. A system for producing realistic tactile feedback forces 
according to Claim 19 wherein said piston-type members are 
mechanically linked to said simulator implement. 
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21. A systtm for producing realistic force feedback in 
simulated situations comprising: 

(a) a predetermined landscape environment; 

(b) an instrument adapted for movement within said 
environment; 

(c) sensing means including a plurality of sensors for 
sensing the movement of said instrument within said environment 
and for producing electrical indicia indicative thereof; and 

(d) force simulation means responsive to said electrical 
indicia for imparting to said instrument simulated real-life 
forces representing said movement. 

22 • A system according to Claim 21 wherein said sensing means 
include means for sensing the position of said instrument, 
wherein said electrical indicia include indicia indicative of 
said position of said instrument, and wherein said force 
simulation means includes means for imparting to said instrument 
simulated real-life forces reflecting said position of said 
instrument . 
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23* A method of producing realistic tactile feedback forces in a 
tool operation simulator comprising: 

(a) selecting a predetermined simulated operational 
environment , 

5 (b) defining said predetermined simulated operational 

environment by defining electrical signals; 

(c) providing a simulator implement simulating a selected 

tool; 

(d) manually controlling movement of said implement 
10 relative to said simulated operational environment; 

(e) positioning a plurality of sensors in sensing relation 
to said implement, said sensors being responsive to movement of 
said implement to produce electrical signals representative of 
movements of an actual tool of the type simulated in an actual 

15 environment of the type being simulated; 

(f) providing a plurality of force creating members in 
force- imparting relation to said implement; 

(g) interconnecting said representative electrical signals 
and said defining electrical signals with said force-creating 

20 members; and 

(h) conditioning said force-creating members to respond to 
said representative and defining electrical signals to impart 
proportioned forces to said implement* 



25 



8NS0OCID: <WO 9618942A1> 



WO 96/18942 



PCT/US95/16360 



24. The method of Claim 23 further including providing 
electronic memory and storing said electrical signals in said 
memory * 

25. The method of Claim 23 further including digitizing said 
defining electrical signals . 

26. The method of Claim 24 further including digitizing said 
defining electrical signals. 

27. The method of Claim 23 further including digitizing said 
defining and representative electrical signals. 

28. The method of Claim 24 further including digitizing said 
defining and representative electrical signals, 

29. The method of Claim 23 further including steps of providing 
a plurality of different selectable simulated tools and selecting 
said tool from among said plurality of different selectable 
simulated tools. 

30. The method of Claim 29 wherein said step of selecting said 
tool from among said plurality of different selectable simulated 
tools is performed by an operator. 
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31. The method of Claim 23 further including representing 
identity of said selected tool by developing a predetermined 
electrical signal. 

32. The method of Claim 24 further including representing 
identity of said selected tool by developing a predetermined 
electrical signal. 

33. The method of Claim 32 further including providing 
electrical memory, digitizing said predetermined electrical 
signal to produce a digitized electrical signal and storing said 
digitized electrical signal in said electrical memory, 

34. The method of Claim 23 further including causing said 
sensors to respond to positioning of said implement for 
developing position-indicating indicia indicative of the position 
of said implement within said simulated operational environment. 

35. The method of Claim 23 further including causing said 
sensors to respond to positioning of said implement for 
developing position-indicating electrical signals indicative of 
the position of said implement within said simulated operational 

5 environment. 

36. The method of Claim 3 5 further including digitally encoding 
said position- indicating electrical signals. 
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37. The method of Claim 23 further including rendering said 
force-creating members fluid responsive. 

38 . The method of Claim 23 further including rendering said 
force-creating members responsive to compressible fluid. 

39. The method of Claim 23 further including rendering said 
force-creating members responsive to compressed air. 

40. The method of Claim 23 further comprising a step of 
including within said force-creating members compressed air 
responsive pistons. 

41. The method of Claim 4 0 further comprising a step of 
including within said force-creating members bi-directional 
pistons. 

42. The method of Claim 41 further including a step of 
mechanically connecting said force-creating members to said 
simulated instrument. 
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43. A method of producing realistic tactile force feedback 
comprising: 

(a) disposing a predetermined simulated landscape 
env ironaent ; 

5 (b) positioning a simulated instrument at least partly 

within said simulated landscape environment; 

(c) sensing the position of said instrument within said 
simulated landscape environment; 

(d) producing electrical indicia representing said position 
10 of said simulated instrument within said simulated landscape 

environment; 

(e) processing said electrical indicia to produce tactile 
force feedback forces representative of real-life analogs of said 
simulated instrument; and 

15 (f) applying said tactile force feedback forces to said 

simulated instrument to impart to said simulated instrument a 
real-life feel. 

44. The method according to Claim 43 wherein said sensing 
is continuous. 

45. The method according to Claim 43 wherein the step of 
processing said electrical indicia is effective to produce 
tactile force feedback forces representative of real-life analogs 
of said simulated instrument and simulated movement of said 
instrument. 
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